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Abstract 

We consider the problem of reconstructing a wide sense stationary band-limited 
process from its local averages taken either at the Nyquist rate or above. As a 
result, we obtain a sufficient condition under which average sampling expansions 
hold in mean square and for almost all sample functions. Truncation and aliasing 
errors of the expansion are also discussed. 
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1. Introdution 

The classical Whittaker-Shannon-Kotel'nikov (WSK) sampling theorem [l|, 
S)9 says that a signal f(t) in PW^w, the Paley- Wiener space of functions band- 
limited to [— TTo;, TTo;] (to be specified in Section [3]), is uniquely determined by 
its discrete samples /(ri,/a;)'s, ri G Z, and can be reconstructed via 



/W = E/(-)sincM-n) 



which converges in L^(R) and uniformly and absolutely on R, where sinci := 
sin7rt/(7rt). 

It is well known that the WSK sampling theorem has its counterpart for 
stochastic processes. The counterpart for wide sense stationary band-limited 
processes, definition of which is to be specified in Section [21 is first introduced 
by Balakrishnan [3| , and developed further by many more authors, among them 
Lloyd and Beutler Q . Note that the sampling expansion in [3, @| is shown 
to converge both in mean square and with probability 1, while the expansion 
in Q is shown to converge in mean square only. There also has been an effort 
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to extend the class of stochastic processes to which the WSK sampHng theo- 
rem apphes. Zakai extended the notion of band-hmited stochastic processes 
and proved the WSK samphng theorem hold over this extended notion. Using 
Zakai's technique, Lee [1] extended it to the class of second order measurable 
mean square continuous processes whose covariances are polynomially bounded. 
Belyaev and Piranashvili [l^l defined classes of the analytic processes, for 
which almost all trajectories can be analytically continued. Then they derived 
the WSK sampling expansion which holds either with probability 1 or for almost 
all sample functions in their classes. 

Recently, an average samplin g ex pansions (ASE's) for stochastic processes 
have been investigated in Since acquisition devices do not produce 



signal values at the exact instances, in practice it seems more reasonable to use 
local averages instead of point evaluations. We call this sampling procedure the 
average samphng. The ASE on band-limited functions was first presented by 
Grochenig 14 1, and then extended in 1^ 16, 17|. In 14 1, the author treated 



the problem of reconstructing a band-limited function from its local averages 
(/, Un) = J f{t)un{t)dt around t„, where {ti„(t) : n G Z} is a sequence of average 
functions satisfying 

suppu„(i) C [i„ - -,t„ + -], < u„(t), and / Un{t)dt = \. (1) 

^ ^ J — oo 

More precisely, he proved that for any f{t) in PW^^^, if < t^+i — tn < S < 
l/(-\/27raj) then f{t) is uniquely determined by the local averages (/, u„)'s, n S 
Z, and can be reconstructed by some iteration scheme. Applying the iteration 
scheme with {(/, it„) : n G Z} is equivalent to finding a frame expansion of / 
on PWttoj, coefficients of which correspond to {(/, u„) : n S Z}. That is, if the 
aforementioned condition is satisfied then there exists a frame {rnit) : n S Z} 
of PWttuj such that 

nez 

which converges in i^(]R) and pointwise on K. Note here that {Vun : n G Z} 
and {r„ : n € Z} arc dual frame pairs of PWttuj where V denotes the orthogonal 
projection of i^(R) onto PWttu- 

Using Grochenig's result, Song et al. [ll| addressed an ASE for band- 
limited stochastic processes. To be precise, let X{t), —oo < t < oo, be a 
wide sense stationary stochastic process band- limited to [— 7raj,7raj] and Rxit) 
be its autocovariance function. Under the same notation and the assumption 
as in Grochenig's, they proved that if 

{t„ : 7T. e Z} is relatively separable, (3) 

i.e., there is some constant N such that [k, fc + 1] n {i„ : n G Z} contains at most 
N elements for all fc S Z, and 

\Rx{t)\ < Rx{0){l + \t\)-'^ for some ?7>1, (4) 
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then 

=^(X,M„)'^nW (5) 



which converges in mean square, i.e., 

N 



hm E 

JV->oo 



X{t)- {X,u„)r„{t) 



2 

= 0, 



for any i G K. It is assumed here that_jr„(t) : ri e Z} is a frame of PWttuj 
for which ([2]) holds. Later, He et al. [Ij] provided an ASE to approximate 
wide sense stationary band-hmited processes and, more generally, Olenko et 
al. presented an ASE to approximate Piranashvili's processes. But their 
ASE's are asymptotically equivalent to the WSK sampling expansion, i.e., a 
point sampling. 

It should be noted that the condition (|4]) seems too strong. For instance, 
consider class of linear combinations of {sinc(a;t — n) : n £ Z}, denoted by 
PW°^. Then PW°^ is dense in PWttuj, i.e., any function in PW-kuj can be 
approximated in L^(M) by a limit of a sequence of functions in PW°^, and for 
any f{t) e PW°^, \f{t)\{l + Itiy' oo as |t| oo whenever rj > 1. In fact. 



one can prove Theorem 2.2 of [ijj without assuming the condition ^ and 
based on the observation that ([2]) converges unconditionally on K (sec Theorem 

m- 

In this paper, we show that the average sampling theorem given in 
remains true without the condition ^ and (jH). We also provide an average 
sampling theorem with local averages taken at the Nyquist rate, while only 
oversampled local averages were considered in [llj . Success of a perfect recon- 
struction from local averages via the resulting expansion depends only on the 
length of support of average functions u„ , which improves the results of [Ulill. 



The latter ASE of ours not only converges in mean square but also converges 
for almost all sample functions. Under band-guard condition (see e.g. [l8| ) we 
derive explicit upper bounds on the truncation error of the ASE. Aliasing error 
is also discussed. 

This paper is organized as follows. In Section [5] we introduce notations and 
definitions needed throughout the paper. In Section [3] we present an average 
sampling theorem in which local averages are taken above the Nyquist rate 
(oversampling) . In Section 2] we show that band- limited stochastic processes 
can also be reconstructed by its local averages taken at the Nyquist rate. It is 
shown that the resulting ASE converges both in mean square and for almost 
all sample functions. Finally in Section [5] truncation and aliasing errors of the 
expansion are discussed. 

2. Notations and definitions 

The Paley- Wiener space of signals band-limited to [— ttcj, ttlu] is defined by 
PWjr^ := {/ e L^{R) n C(]R) : supp/ C [-ttlo, ttlo]} 
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where we define the Fourier transform as = fiO •= /-!^ /(O^"**^^*; 

/ e L-'^(IR), and extend it to an isomorpliisni from L^(R) to L^(R). 

A sequence {0„ : n € Z} of vectors in a separable Hilbert space H equipped 
with the norm || • ||-^ is 

• a frame of H with bounds {A, B) if there arc constants B > A > Q such 
that 

A\\frn<Y,\{fA.:)n?<B\\f\\l,, fen; 

• a Riesz (or stable) basis of H with bounds {A, B) if {0„ : n £ Z} is 
complete in % and there are constants B > A > Q such that 



A\\cf < II cW0„ < S||c||2, c := {cH}„ e £2(2^ 



where = Enez\<^)\' ■ 

A stochastic process {X{t) : t G R} is wide sense stationary if E{X(t)) = 
and E\X{t)\'^ < oo for i e M and the autocovariance function Rx{t,s) := 
E{X{t)X{s)) depends only on the difference t — s. By the spectral representa- 
tion theorem [l9|, a wide sense stationary process {X{t) : t G R} has a spectral 
representation: X{t) = J_ e**^(iy(A), t S R, where the process y has orthog- 
onal increments and F is the spectral distribution function of {X{t) : t G R} 
such that E\dy{X)\^ = dF{X). 

{X{t) : t G R} is said to be band-limited to [—ttuj,ttuj] if its spectrum 
has the support [— 7rw,7rw], i.e., X{t) = J^'^^e^*^dy{X), t G R. Since X{t) = 
JZ^e^'^dyiX) if and only if Rxit,s) = e'(*-^)^di^(A) 0, : t G 

R} is also said to be band-limited to [— 7ra;,7ra;] if Rx{t) is band-limited to 
[-7rw,7rw], i.e., Rxit) G PW^^. 

We denote by (•, •) the usual inner product in L^(R) unless otherwise speci- 
fied. 



3. Oversampled local averages 



We extend Theorem 2.2 of into the following theorem by removing the 
aforementioned condition and the constraint for {t„ : n G Z} being relatively 
separable. 

Theorem 3.1. Let {unit) : n G R} be a sequence of average functions satisfying 
p]). For a wide sense stationary process X(t) band-limited to [— ttoj, ttoj], if 
tn+i ^ tn < d < l/{\^TTUj) then 

X{t) = J2{X,u„)rr,it) (6) 

which converges in mean square, uniformly on any compact subset of R, where 
{r„(t) : n G Z} is a frame of PW^^u for which ^ holds. 



4 



Proof. Since E\X{t)\'^ < oo for t eM., we have by Fubini's theorem that for any 
t gM. and any positive integer A^, 



N 

E\xit)- {X,Un)rn{t) 

n=~N 

N N 
n=-N n=-N 

+ zZ j j Rx{x - y)un{x)uk{y)dxdyrk{t)rn{t). (7) 



We first show that the double summation ([7]) converges unconditionally for any 
t £M. as N goes to infinity. Since Rx{t' — ■) ^ PW-j^^ for t' e R, we obtain from 
^ that for a given i' e M 

t .+- 

Rx[t' - t) = Y, r ^ Rx[t' - v)uk {y)dy {t) . (8) 

It should be noticed that ([5]) converges unconditionally for each t G K and 
uniformly on M since ([2]) is a frame expansion in PWttoj so that it converges 
unconditionally both in L^(R) and pointwisc on R and moreover the pointwise 
convergence is uniform: this follows by Corollary 3.1.5 of [2l| together with 
PWttw being a reproducing kernel Hilbert space with bounded reproducing ker- 
nel Setting t = t', we have 

which converges unconditionally for any t e M. Furthermore, (|9]) converges 
uniformly on any compact subset of R (Theorem 7.13 of [ISl)- 

Now, for a given a; e R, let ah^x{t) := Rx{x - y)uk{y)dy rk{t), i e R. 

Then J2k£Z^k.xit) converges unconditionally to Rx{x — t) for any t G R and 
uniformly on R (with respect to t). Thus 



^lini^ X! / ^ afc^2:(0)wn(a;)'^a;r„(t) = ^ / ^ Rxix - t)un{x)dx r„{t) 



converges unconditionally to Rx (0) for any i S R and uniformly on any compact 
subset of R; so that the double summation ^ converges unconditionally for any 
t e R and uniformly on any compact subset of R as goes to infinity. 

Since the absolute convergence is equivalent to the unconditional convergence 
for real- or complex- valued series (see e.g. Lemma 3.3 of j24|). 



hm } / Rx{x - y)un{x)uk{y)dxdyrk{t)rnit) (10) 

N—>-oo ^ — ' L s L 6 

AT tl-~ t: ^ tn. — T^ 
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converges absolutely for any i G R. 

Thus it follows by dH) that for any t £ 



Y[ ^ (X! / , Rx{x - y)uk{y)dyrk{t)^ Un{x)dsrn{t) 
j ^ Rx{x - t)un{x)dsrr,{t) 



Rx{0) 



from which wc have limAr_j.oo E 



X{t)~Y.n=-N{X,Un)r.n{t)^ 



0, uniformly on 

any compact subset of M. □ 

The globally uniform convergence of ([6]) is not guaranteed in general. It 
is worth mentioning that the necessary and sufficient condition for the WSK 
sampling expansion of so-called I-process, i.e., a band- limited stochastic process 
possessing an absolutely continuous spectral distribution function, to be globally 



uniformly convergent is addressed in [25 



The WSK sampling theorem for band-limited stochastic processes 0, [1, 0] 
states that any X{t) band- limited to [— 7rcj,7raj] can be reconstructed by 

= y X(-)sinc(wt - n) 

which converges in mean square or with probability 1 for any f € M. In this 
case, the samples {X{n/uj) : n £ Z} are taken at the Nyquist rate uj. However, 
Theorem l3 . II does not cover the case of local averages taken at the Nyquist rate, 
{{X,Un) : n g Z}. since if t„ = n/u> then tn+i — tn = 1/w > l/(-\/2w7r), n e Z, 
where suppu,i C [t„ — (5/2, i„ + (5/2]. 



4. Local averages taken at the Nyquist rate 

In this section wc consider the case of local averages {{X, u„) : n € Z} taken 
at the Nyquist rate. In what follows, we assume uj = 1. The aim of Section U is 
to derive an ASE of the form: 

Xit) = Y,{X,Vn)snit) (11) 

which converges in a proper sense. Here, {s„(i) : n S Z} is a frame of PWt^ and 
{vn(t) : n S Z} is a sequence of average functions satisfying 

supp Vn d [n — a, n + b] for a,b > and a + b > 0, (12) 

/oo rn-{-h 
Vn{t)dt = / Vn{t)dt = 1, ne Z. 
-oo J n — a 

Our main results, Theorem 14.21 and I4.3[ are based on the following ASE in 
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Proposition 4.1 (Theorem 3.2. of [26|). Let {vnit) : rt € R} fee a sequence of 
average functions satisfying (|12p and let S := max{a, fe}. // S{a + b) < I/tt, 
then there is a frame {sn(t) : n € Z} of PWtt such that 

f{t)=Y,{f,Vn)Snit), f ePW^ (13) 

which converges in L^(R) and uniformly and absolutely on R. In this case, 
{sn{t) : ri e Z} and {Vv„(t) : n € Z} are dual frame pairs of PW^^ where V is 
the orthogonal projection of L'^iM) onto PWtt- 

Proof Let (l){t) sinc(t). Note that is differentiable, (j)' e L^(R), \Z^{0,^)\ = 
1 for e e M, and \\Z^,it,0\\i^iR-) = ^, where Zfit,^) := E„6Z " 
denotes the Zak transform |27[ of f{t) £ L^(R). Then Proposition 14.11 is an 
immediate consequence of Theorem 3.2 of [i^ with (^(t) = sine(t). □ 

Since Rx{t' — ■) ^ ^'W^tt for a given t' e R, assuming \J 5{a + b) < I/tt, we 
have by Proposition 14. II 

Rx{t' -t) = Y,{Rx{t' ~ ■),vn{-))sn{t), teR (14) 

which converges in L^(R) and absolutely and uniformly on R. As already men- 
tioned in the proof of Theorem 13.11 the absolute convergence is equivalent to 
the unconditional convergence for real- or complex-valued series, so ()14p also 
converges unconditionally on R. 

With the same definition as in Proposition we have a counterpart state- 
ment for stochastic processes: 

Theorem 4.2. Let {X(t) : t G R} be a wide sense stationary process band- 
limited to [— TT, TT ]. // ^y5{a + b) < I/tt, then (HH) converges m mean square, 
uniformly on any compact subset o/ R, where {sn(t) : n £ Z} is a frame of 
PW^ for which HH) holds. 

Proof. The proof is essentially the same as the proof of Theorem 13.11 □ 

Furthermore, we prove the ASE (jlip converges for almost all sample func- 
tions. 

Theorem 4.3. Let the notation and the assumption be the same as in Theorem 
\4.^ Then (jlip holds for almost all sample functions. 

Proof. Let 

X{t) lim V {X,v„)sn{t) (15) 

|Ti|<Af 

in mean square sense. We have shown in the proof of Theorem 13.11 (with a 
proper modification of the notation) that for any t e K 

N 

E\X{t)-X{t)\^ ^ lim E\X{t)^ V {X,v,,)sn{t)\\ 

A/"— Von ' * 
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Thus, X{t) = X{t) with probabihty 1 by Theorem O The right of ^ 
converges uniformly on any compact subset of M and X{t) is continuous for 
almost all sample functions: in fact, almost all sample functions are entire 
functions Then the theorem follows. □ 



5. Error estimation 

The aim of this section is to estimate truncation and aliasing errors of the 
ASE pT|) . To this end we always assume ^J5{a + b) < I/tt so that, by Theorem 
14.31 {Vvnit) : n G Z} and {s„(t) ; n G Z} are dual frame pairs of PW^r for 
which holds for almost all sample functions of a given wide sense stationary 
process X{t) band-limited to [—tt,tt]. Here, V is the orthogonal projection of 
L^(R) onto PWtt- Note that is a shift-invariant operator, i.e., 'P[f{- — n)]{t) = 
Vfit -n), n G Z, for any / G L'^{M.). 

In the following we assume further that Un{t) = u{t — n) for n G Z. Then 
{'Pun{t) ~ Vu{t — n) : 77, G Z} is a frame of PW^^ if and only if there exist 
constants B > A > Q such that 

A < \u{0\ < B a.e. on [-tt, tt] (16) 



(Theorem 2 of |28|). As a matter of fact, the condition is also a sufficient 
and necessary condition for {Vu{t — n) : n G Z} to be a Riesz basis of PWt^. 
Since Vu{t) G PW^, we have by ^ 



Vu{t) = ^(7'it(-), u{- - n))s{t - n) 
so that, via the Fourier transform, 

which holds in L^(M) where u(^) is 27r-periodic extension of ^(01 [^^^ tt]' 
restriction of ■u(^) on [— tt, tt]. Thus we have 

^ = iO a.e. on M. (17) 

In summary we consider the ASE of the form 

X(t) = ^(X(.),^.(.-n))s(t-n) (18) 

nez 

where u{t) and s{t) satisfy p6| and ((T7)) . respectively. 

It is, by definition, unavoidable that s(^) has discontinuities at ±7r. Thus, 
for a given t G M, .s(t — n) decays slowly as n goes to infinity so that convergence 
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speed of (|T5)) is also slow. To overcome this, we adapt so-called oversampling 
technique by the guard-band assumption. This is introduced in [2^, [3 Hol to 
estimate truncation error bound of the WSK sampling expansion of band- limited 
functions. The same method is also applied to truncation error estimation of 
the WSK sampling expansion of band-limited stochastic processes [31 1 . 

Consider /(t) G PW^ where < oj < n, i.e., supp/ C [— ^,0;] C [— 7r,7r]. 
Since PW^: C PWt^, we have by Proposition STT] 

f{t) = Y,{f{-),u{--n))s{t-n) 
which is, via the Fourier transform, equivalent to 

fio = hmo = E(/(-)'"(- - ^))^(o^(^)e-"« (19) 

where 9{£,) is an arbitrary smooth function satisfying 9{^) = 1 on [— and 
9(0 = on ]R\[— TT, tt]. Applying the inverse Fourier transform on ([T9| gives 

/W = E (/(■)' ^(•-"))*~(^-") (20) 
nez 

where 

m = mm = =m (21) 
m) 

in L2(k). Note that ~s{t) € PW^. 

Lemma 5.1. For s{t) € PW^r satisfying (|2ip . if 0{^) is p-times continuously 
differ entiable for some integer p > 1, i.e., 9{^) G CP(M), then for any given 
t e M 

\~sit-n)\<^, neZ (22) 

where 

^ 1 ... 

d^<oo. (23) 



Cp{t) ■■= r (^0(e)e-'*«)(^) 
27r u(^) 



Proof. Note first that w(t) is compactly supported so that u{^) is infinitely many 
diflterentiable on M. Since 

27r 27r u(^) 

is the n-th coefficient of the Fourier series of p-times continuously differentiable 
function d{£,)e''*^ /u{£,) vanishing at ±7r, on [— 7r,7r], we have 

(=6'(C)e**«)(p)e-™«d^ = -{-in)P f =6l(0e'*«e-"«dC -27r{^inf§{t - n) 

-7r u(0 -^-TT "(0 



which implies ([22|) . □ 
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Theorem 5.2. Let X(t) be a wide sense stationary process band-limited to 
[^io,io] C [— TT, tt] and Rx{t) the autocovariance function ofX(t). Assume that 
ASE (|18p holds. Then we have for any t € M 



Xit) = J2{Xi-),ui-~n))S{t-n) 



(24) 



nez 



which converges in mean square where s{t) is given by (1211) . Morever, if 0{^) in 
(|21[) belongs to C^(K) for some integer p > 1 then 



E\X{t)~XN{t)\^ < 



ARxiO)Cp(t)^ 
{p - lyN^(p-i) 



whe 



XNit) ■■= J2 {Xi-),ui--n))~sit-n) 

\n\<N 

and Cp{t) is given by (j23[) . 

Proof Since Rx(t' - ■) e PW^ for a given t' e R, it follows by ^ that 
Rx{t' -t) = ^{Rx{t' - ■),u{- -n))S{t-n), t e M 



(25) 



which converges in L^(R) and absolutely and uniformly on M. Using ((25)) we 
can obtain (|24p by the same argument as in the proof of Theorem 13.11 
For any i e M it follows that 



E\X{t)~XNit)\^ = s| ^ (X,u„)S„(t) 

\n\>N 



< 



< 



< 



E 

\n\>N 

E 

ln|>Af 



n+b 



E 

fe|>JV 

E I 

A;|>Af 



fe+6 



Rx{x - y)uk{y)dysk{t)]un{x)dx s„(t) 



k~a 
k+b 
k — a 



Rx{x - y)uk{y)dy Sk{t) \un{x)dxsr. 



rn+D 

sup \Rx{t)\ / ( E \Sk{t)\)u„{x)dxSn{t) 

-{a+b)<t<a+b |„|>Ar-^«-'^ |fc|>JV 



|Ti|>Af ' 
2 



\k\>N 



in which Sk{t) = s{t — k) and Uk{t) = u{t — k) for k ^ "L. By Lemma 15.11 
combined with the integral test, 



\k\>N 

which proves the theorem. 



k>N 



kP 



{p- l)iVP-i 



□ 
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As already mentioned, {Vult — n) : n £ Z} and {s{t — n) : n G Z} are dual 
Riesz basis pairs of PW^. Thus the orthogonal projection V of onto PWV 

can be written as 

To consider an aliasing error of ASE ([TT|) , we extend V for stochastic processes 
as 

VX{t) Y.^X{-),Vu{- - n))s{t - n). 

Assuming that ASE (|lip holds for wide sense stationary processes band-limited 
to [— TT, tt], one can easily see that for any i € R 

E\X{t)-VX{t)\^ = [ F{dX) 

J\\\>Tr 

where F is the spectral distribution function of X{t). 
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